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Abstract. It is shown that the deformed Macdonald-Ruijsenaars op- 
erators can be described as the restrictions on certain affine subvarieties 
of the usual Macdonald-Ruijsenaars operator in infinite number of vari- 
ables. The ideals of these varieties are shown to be generated by the 
Macdonald polynomials related to Young diagrams with special geom- 
etry. The super Macdonald polynomials and their shifted version are 
introduced, the combinatorial formulas for them are given. 

1. INTRODUCTION 

In this paper we investigate the properties of the deformed Macdonald- 
Ruijsenaars (MR) operators introduced in yy 



^ n ^ m 

Y—EMt,,.. - 1) + ^ - 1)' (1) 



I — (I — ^ ^ 

=1 j=i 

where 



-A- {xj - txk) ^ {xj - qyj) „ _ TT iVj - txj) -fr ivj - qyi) 



{xt - Xk) j-J^ {xi - Vj) fj^ {yj - Xi) fj: {yj - yi) 

and Tq^Xi^Tt^yj are the "shift" operators: 

{TqjXif){xi, • • • ) . . . , Xjii yi ) • • • ) Urn) ~ f {xit ■ ■ ■ , QXi, ■ ■ ■ , Xn, 2/1 ; • • • ; ym) 

iTt,yjf){xi, ...,Xn,yi,.. .,yj, . . .,ym) = f{xi, ...,Xn,yi,.. .,tyj, . . .,ym)- 
More precisely, we generalise the results of our paper [2] by showing that 
the deformed MR operator can be described as the restriction of the usual 
Macdonald-Ruijsenaars operator jSj S] 

for infinite number of variables Zi onto certain subvarieties A(n,m,g, t). 

As well as our previous paper p] this work is based on the theory of 
Macdonald polynomials [4J and shifted Macdonald polynomials developed 
by Knop, Sahi and Okounkov [H [U [71 [8j . The paper [9] by B. Feigin, Jimbo, 
Miwa and Mukhin was very useful for us in understanding the role of special 
parameters in this problem. Another important relevant work is the paper 
[10] by Chalykh, who used a different technique to derive and investigate 
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the deformed MR operator in the case m = 1, which was the first case when 
the deformed Calogero-Moser systems were discovered (see [IT]). 

The structure of the paper is following. First we review some basic facts 
from the theory of Macdonald polynomials and Cherednik-Dunkl operators. 
The main results about deformed MR operators are proved in section 5. 
We introduce the super Macdonald polynomials as the restriction of the 
usual Macdonald polynomials on A{n,m, q,t). In section 6 we define their 
shifted versions and show that for any shifted super Macdonald polynomial 
there exists a difference operator commuting with M.n,m,q,t (a deformed 
version of Harish-Chandra homomorphism) . In the last section we present 
some combinatorial formulas for the super Macdonald polynomials and their 
shifted versions generalising Okounkov's result [8j. 

2. Symmetric functions and Macdonald polynomials 

In this section we recall some general facts about symmetric functions and 
Macdonald polynomials mainly following classical Macdonald's book [4J. It 
will be convenient for us to use instead of the parameters q, t in Macdonald's 
notations of Macdonald polynomials the parameters q,t~^. 

Let P]sf = C[xi, . . . ,xn] be the polynomial algebra in N independent 
variables and A^v C Pn be the subalgebra of symmetric polynomials. 

A partition is any sequence 



containing only finitely many nonzero terms. The number of nonzero terms 
in A is the length of A denoted by /(A). The sum | A |= Ai + A2 + . . . is called 
the weight of A. The set of all partitions of weight is denoted by Vn- 

On this set there is a natural involution: in the standard diagrammatic 
representation [1] it corresponds to the transposition (reflection in the main 
diagonal). The image of a partition A under this involution is called the 
conjugate of A and denoted by A'. This involution will play an essential role 
in our paper. 

Partitions can be used to label the bases in the symmetric algebra Atv- 
There are the following two standard bases in A^v, which we are going to 
use: monomial symmetric polynomials mx,X G Vn, which are defined by 



summed over all distinct permutations a of A = (Ai, A2, . . . , Aat) and power 
sums 



X — (Ai, A2, . . . , Ar . . . ) 
of nonnegative integers in decreasing order 

Ai > A2 > • • • > Ar > . . . 



mxixi, . . .,xn) = 




. . .X 



AN 
N 



PX = PX1PX2 



PX 



where 



Pk = x'l + x^ + 
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It is well-known [3] that each of these sets of functions with 1{X) < N form 
a basis in Aat. 

We will need the following infinite dimensional versions of both Pjy and 
A]sf. Let M < N and ipN,M '■ Pn — > Pm be the homomorphism which 
sends each of xm+i, ■ ■ ■ ,xn to zero and other Xi to themselves. It is clear 
that (/7iv,A/(Aiv) = Am so we can consider the inverse limits in the category 
of graded algebras 

P = limPN, A = limAAr. 

This means that 

P = (BZoP", P' = \im PJ:^ 

A = ©^oA", A'- = limA:v 

where P^, A^ are the homogeneous components of P/v, A^r of degree r. The 
elements of A are called symmetric functions. Since for any partition A 

V'N,M{'mx{xi, . . .,xn)) = mx{xi, . . .,xm) 

(and similarly for the power sums) we can define the symmetric functions 
mx,px. 

Another important example of symmetric functions are Macdonald poly- 
nomials Px{x,q,t). We give here their definition in the form most suitable 
for us. 

Recall that on the set of partitions Vn there is the following dominance 
partial ordering: we write /i < A if for all i > 1 

A^i + H + Aij < Ai + A2 H h Aj. 

Consider the following Macdonald- Ruijsenaars operator (MR operator) 

1 - q ^ ^j}-. Xi - Xj 

where Tq^Xi is the shift operator 

{Tq,xJ) (xi, . . . , Xi, . . . , xn) = f{xi, qxi, xn) 

This operator is related to the operators Dj^ and Ejy from Macdonald's 
book [4J by the simple formulas 

Our choice of the additional coefficient in formula ([3]) was motivated by 
the symmetric form of the deformed operator ([T]). We should note also that 
the operator ^ is related in a simple way to the trigonometric version of 

the operator Si introduced by Ruijsenaars 
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An important property of the MR operator is its stability under the change 
of N: the fohowing diagram is commutative 



(iV) 
g.t 

N > ^i-AT 

i fN,M I 'PN,M 



Aa. ^ A 



K'P 
Am — ^ Am 

(see page 321 in [1]). This allows us to define the MR operator on the 

space of symmetric functions A as the inverse limit of A^^^^ 

Recall [4J that Macdonald polynomials P\{x,q,t) G Ajy are uniquely de- 
fined for generic parameters q,t and any partition A, Z(A) < by the fol- 
lowing properties: 

1) Px{x, q, t) = mx + E/,<A uxf,m^, where = ux^iq, t) e C 

2) P\{x,q,t) is an eigenfunction of the Macdonald operator -M.^^^ . 

Indeed the operator M^^t has an upper triangular matrix in the mono- 
mial basis m^: 

where the coefficients can be described explicitly (see [1], page 321). In 
particular 

For generic parameters g, t the coefficients ca,a 7^ c^.a* for all A 7^ with 
|A| = so the operator M.'^^^ is diagonalisable. 

We should note that the coefficient are rational functions of q and t, 
which have the singularities only if q°' = t^ for some non-negative integers a, b 
(not equal to zero simultaneously) [4j. Such parameters are called special, 
the Macdonald polynomials are well-defined for all non-special values of 
parameters q,t. 

From the stability of the Macdonald operators it follows that 
V'Af,M(-PA(a:;i, • • ■,xn)) = P\{xi, . . .,xm) 
so we have correctly defined Macdonald symmetric functions P\{x,q,t) G A 
which are the eigenfunctions of the Macdonald operator A^g^\ 

3. Shifted symmetric functions and shifted Macdonald 

polynomials. 

We discuss now the so-called shifted Macdonald polynomials investigated 
by Knop, Sahi and Okounkov O El O E! • 

Let us denote by A^r^^ the algebra of polynomials f{xi, . . . ,xn) which are 
symmetric in the "shifted" variables Xif~^. This algebra has the filtration 
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by the degree of polynomials: 

(A7V,t)o C (A7v,t)l C • • • C {AN,t)r c. . . 
We have the following shifted analog of power sums: 

N 

p;(xi,...,xjv,t) = 5^«-l)t^(^-i) (4) 
1=1 

The polynomials 

Plix,t) =pl^{x,t)pl^{x,t)..., 

where A = (Ai, A2, • • • , Aj. ...) are partitions of length 1{X) < N, form a 
basis in A^r^t. They are stable in the following sense. Let M < N and 
: Pn — > Pm be the homomorphism which sends each of x m+i , ■ ■ ■ ,xn 
to 1 and leaving the remaining Xi the same. Then f^^iPxixl, ■ ■ ■ jX^)) = 
p*)^{xi, . . . ,xm)- Therefore 99^^(A7v,t) = A.M,t and one can consider the 
inverse limit 

At = hm AN,t 

in the category of filtered algebras: 

00 

At=\J iAt)r, iAt)r = hm(A7V,t)r- 
r=0 

The algebra At is called the algebra of shifted symmetric functions ff, '8] . 
Let us introduce the following function on the set of partitions: 

H{X, q, t) = Yl - . (5) 

Here a{s) and l{s) are "arm" and "leg" lengths respectively of a box s = 
{i,j) G A, which are defined 

a(s) = Xi- j, l{s) = X'j-i 

and 

n(A) = ^(z - 1)A,. 

Recall (see [6l|7ll8]) that the shifted Macdonald polynomial P^ix, q, t) G At 
is a unique shifted symmetric function of degree degPx = I'^l satisfying the 
following property: 

PUq\q,t)=HiX,q,t) 
and PxiQ^jQjt) = unless A C (Extra Vanishing Condition). Here and 
later throughout the paper by P{q^) for a partition A = (Ai, . . . , Xn) we 
mean P(g^i,...,g^^, 1,1,...). 

We will need the following duality property of the shifted Macdonald 
polynomials proved by Okounkov [8j 
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To show this consider the following conjugation homomorphism (cf. [2j): 

[Kt(/))] it') = /(/) (7) 
We claim that the conjugation homomorphism maps the algebra of shifted 
symmetric functions At into the algebra Aq. Indeed computing the sum 

first along columns and then along the rows we come to the following equality 

j>i *>i 
which is equivalent to 

with r = 1. Replacing q by q^ and t by f we have this formula for all r. 
Now the claim follows from the fact that p*^{x,t) generate the algebra. 

Combining this with the definition of the shifted Macdonald polynomials 
we have the duality property dH). 

4. ChEREDNIK - DUNKL OPERATORS AND HARISH-ChANDRA 

HOMOMORPHISM 

In this section we present the basic facts about Cherednik-Dunkl opera- 
tors. For more details we refer to [12\ |13j. 
Consider the operators Ti,i = 1, . . . , N — 1 

Ti = l-\ (cJii+i - 1) 

and 

UJ = aNN-lO'N-lN-2 ■ ■ ■ 0'2l7g,a;i, 

where dij is acting on the function /(xi, . . . ,xj\f) by permutation of the i- 
th and j-th coordinates. By Cherednik-Dunkl operators we will mean the 
following difference operators 

Di^N = t^-^Ti...TN^iu;T^\..Tr_\, i = l,...N. (9) 

The first important property of the Cherednik-Dunkl operators is that 
they commute with each other: 

[A,iv,I)i,jv] = 0. 

This means that one can substitute them in any polynomial P in variables 
without ordering problems. 

The second property is that if one does this for a shifted symmetric poly- 
nomial g G A]\f^t then the corresponding operator g{Di^N . . . Dn^n) leaves 
the algebra of symmetric polynomials A^r invariant: 

g{Di^N ■ ■ ■ Dn,n) ■ An An- 
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The restriction of the operator g{Di^iq . . . D^^j^i) on the algebra A^v is given 
by some difference operator, which we will denote as T^f^^i- 

One can check that if we apply this operation to the shifted power sum 
pI{xi, . . . ,XN,t) = YliLi i^i ~ 1) arrive (up to a factor (1 — q)~^) 

at Macdonald-Ruijsenaars operator Thus the operators I'^^j can be 
considered as the integrals of the corresponding quantum system, which is 
equivalent to the relativistic Calogero-Moser system introduced by Ruijse- 
naars [3j. 

The Macdonald polynomials are the joint eigenfunctions of all these op- 
erators: if Px{x, q, t) is the Macdonald polynomial corresponding a partition 
A of weight N then 

V%^Px{x,q,t) = g{q^\q^\...,q^^)Px{x,q,t) (10) 

This allows us to define a homomorphism (which is actually a monomor- 
phism) X '■ f ~^ t from the algebra A^ to the algebra of difference opera- 
tors. Let us denote by T>{N, t) the image of x- The inverse homomorphism 

^-^ .,V{N,t)^KN,t 

is called the Harish- Chandra isomorphism. It can be defined by the action 
on the Macdonald polynomials: the image of I? G T^{N, t) is a polynomial 
f = fv ^ ^N,t such that 

VPx{x,q,t) = f{q^)Px{x,q,t). 

One can check that the Cherednik-Dunkl operators are stable: the dia- 
gram 

Pn ^ Pn 

i fN,M i fN,M 

Pm — > Pm 

is commutative for all M < and i > 1. Similarly for any / € Ajv^j and 
g = M^f)^ M < N the following diagram is commutative: 

An — > An 

i ^N,M i fN,M 
■r,9 

Am — > Am 

This allows us to define for any shifted symmetric function / € A^ a differ- 
ence operator 

V( -.A — ^ A 

and the infinite dimensional version of the homomorphism x- We will denote 
by T>{t) the image of this homomorphism. The inverse (Harish-Chandra) 
homomorphism x^^ '■ T^if) — ^ can be described by the relation 

VlPx{x,q,t)= f{q^)Px{x,q,t), 

where now f & At and P\{x,q,t) are Macdonald polynomials. 
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5. Deformed Macdonald-Ruijsenaars operator as a restriction 

The following algebra A.n,m,q,t will play a central role in our construction. 
Let Pn,m = . . . , Xn, 2/1, ... , Um] be the polynomial algebra in n + m 

independent variables. Then An,m,q,t C Pn,m is the subalgebra consisting 
of polynomials which are symmetric in xi, . . . , a;„ and yi, . . . , ym separately 
and satisfy the conditions 

Tq,,,{f)=Tt,y^{f) (11) 

on each hyperplane Xi — yj = for all z = 1, . . . , n and j = 1, . . . ,m. 

Assume from now on that t and q are not roots of unity and consider the 
following deformed Newton sums 

Pr{x,y,q,t) = ^x1 + y-^^y'j, (12) 
i=i j=i 

which obviously belong to An_m,q,t ^or all nonnegative integers r. 

We will prove later that if the parameters q, t are non-special, then An^m;q,t 
is generated by the deformed Newton sums pr{x,y,q,t) (see Theorem 15.81 
below), but now let us start with the following result. 

Theorem 5.1. The algebra An^m,q,t is finitely generated if and only iffq^ ^ 
1 for all 1 < i < n, 1 < j < m. 

Proof. Consider the subalgebra P{k) = C[pi, ...,pn+m\ generated by the 
first n + m deformed Newton sums (|12p . We need the following result about 
common zeros of these polynomials (cf. Proposition 4 in [1]). 

Lemma 5.2. The system 

Xi+X2-\ \-Xn + jE^{x„+i+Xn+2-\ \- Xn+m) = 

^ Xi + X2 + ■ ■ ■ + X^ + ^_^2 (3^n+l + + ' ' ' + ^n+m) — ^ 

n+m I n+m , . . . i „n+m i ( n+m , n+m , . . . i ^n+m\ _ r, 

, -^1 "'"■^2 "I" ' -^n ' i-t"+m \Xn+l ' •^n+2 ' ' -^n+m) ~ 

has a non-zero solution in C""^™' if and only if fq^ = 1 for some 1 < i < 
n, 1 < j < m. 

Proof. Let us multiply the k-th. equation by 1 — t'^ and rewrite it as 

■ + - • ■+Xn+m = {tXl)'' + - ■ ■ + {tXn)'' + {qXn+l)'' + - ■ • + (gx„+^)^ 

Since this is true for all /c = 1, . . . , n + m this means that the set 

Xi, . . . , X^ , Xfi+l 1 ■ ■ ■ 1 2^n+m 

coincides up to a permutation with the set 

tXi , . . . , tXn , qXn+1 , • • • , qXn+m • 
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Let us consider only nonzero elements Xi,i € S C [1, . . . , n] and nonzero 
elements Xn+j,j € T C [1, . . . , m] . Therefore 

JJ a^i JJ Xn+j = n n ^"■+-?' 

Therefore tl-^'gl^' = 1. 

Conversely suppose that t^q^ = 1 for some l<i<n, l<j<m and 
consider 

Xi = 1, X2 = . . . , = t^^\ Xn+1 = q~^t^^\ Xn+j = q~H^~^ 

with other variables to be zero. Then it is easy to verify that it is a solution 
of the system. □ 

From lemma it follows that if t^q^ ^ 1 for all 1 < i < n, 1 < j < m 
the algebra of all polynomials on 1/ is a finitely generated module over 
subalgebra P{k). By a general result from commutative algebra [15j this 
implies that h.n,m.;q,t is finitely generated. 

Conversely, assume that f^q^ = 1 for some 1 < ?' < n, 1 < j < m and 
consider the following homomorphism 

: K,m;q,t ^ C[u,v] 

sending a polynomial /(xi, . . . , x„, yi, . . . , y^) into 

(j)(u, v) = f{u, t-^u, t^-'u, 0, . . . , 0, q^'Hv, q^-^tv, . . . ,tv,0, . . . ,0). 

One can check that the image (p of any / E ^n,m;q,t satisfies the condition 
(j){u, u) = 4>{qu, qu) and therefore 4){u, u) = const since q is not root of 
unity. Moreover one can show that any such function (j) belongs to the 
image of ^ij- The corresponding algebra consists of the polynomials of the 
form (j) = {u — v)p{u, v) + c, which is not finitely generated (c.f. [1], p. 274). 
This completes the proof of the theorem. □ 

Let us assume from now on that q, t are generic. Since algebra h.n,m,q,t is 
finitely generated we can introduce an affine algebraic variety 

Consider the following embedding of /^n,m;q,t into infinite-dimensional 
Macdonald variety M = Spec A (cf. [2]). Recall that A is the algebra 
of symmetric functions in infinite number of variables zi,Z2, ■ ■ ■ , which is 
freely generated by the powers sums Priz) = z\ -\- Z2 + ■ ■ ■ . Consider the 
following homomorphism ip from A to An,m,q,t uniquely determined by the 
relations 

ip{Pr{z)) = pr{x,y,q,t). 
For generic q, t this homomorphism is surjective and thus defines an embed- 
ding (j) : An,rn,q,t ^ M. 

We are going to show that the deformed MR operator ([T]) is the restriction 
of the usual MR operator on Ai onto the subvariety An^m,q,t- 
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We start with the following modification of Proposition 2.8 from paper 
W\ by Chalykh. 



Proposition 5.3. The deformed MR operator preserves the algebra An^m,q,t- 

Proof. Let / G JS.n,m,q,t and g = Mn,m,q,t{f)- Then we have 

"a ^ B 

1=1 j=l 
where Ai, Bj are the same as in ([TJ and 



fi = Tq^x,{f) - f, fj = Tt^y^{f) - f, i = l,...,n, j = 1, 



, m. 



Let us prove first that g is a polynomial. It is clear that g is a rational 
function, which is symmetric in xi, . . . , x„ and yi, . . . , j/m, so it is enough to 
prove that g has no singularities of type (xi — X2)~^ ,{yi — y2)~^ ,{xi —yi)~^. 
Let us represent g in the form 

g = ({xi - X2)-^/i + (xi - X2)-^/2 ) + gi, 

XI-X2 \ l-q l-q J 

where gi is a rational function without singularities on the hyperplane xi = 
X2- But on this hyperplane we have 

(xi-X2)--^/l + (xi-3;2)-^/2 = ({Xl - X2)-^ + (xi - X2)--^ ) fl = 0, 

l-q l-q V 1-^ l-gy 

so we see that g has no poles when xi = X2- Similarly there are no singu- 
larities of type {yi — ^2)"^- Now write g in the form 

g = ({xi - yi)-^^hi + (xi - ) + 52, 

xi-yi \ l-q 1-t J 

where 32 is a rational function without poles when xi = yi- On the hyper- 
plane Xl = yi we have 

therefore 

(2;i-yi)--^/i+(xi-yi)-^/i = ( (xi - yi)-^ + (xi - yi)-^ ) /i = 0. 
l-q 1 — t \ 1 — q i~v 

We have used here that when xi = yi we have /i = /j from the definition 
of algebra An^m,q,t- Thus we have proved that 5 is a polynomial. 

Now let us prove that g G An,m,q,t- On the hyperplane xi = yi we have 
the following equalities: 

[Tq^Xi - Tt^y^) = 0, Z / 1, Tq^xiM = 0, 
{Tq^x,-Tt,y,)B, = Q, j^l Tt,y,Bl = 0, 



Ai_ ^ Bi 
Q 



10 



and therefore 



I 1 ~l {Tt,yiTq^xAf) - Tt,yif) = 



since / G ^n,m,q,t- 

Now we are ready to formulate our central result. Let Mq,t be the usual 
Macdonald operator in infinite dimensions. 

Theorem 5.4. The following diagram is commutative for all values of the 
parameters q,t: 

A — ^ A 

IV^ (14) 



n,m,q,t ' ^^n,m,q,t 



In other words, the deformed MR operator (OP is the restriction of the op- 
erator M.q^t onto the suhvariety l^n,m,q,t C M. 

Proof. Let us introduce the following function H G A[[u)i, . . . ,wn\\ which 
plays an important role in the theory of Macdonald polynomials (see [^): 



A'' oo oo ^ ,_i 

I —t q ZjW 



n=nnn^ 



j=lr=Oi=l ^ J 

Lemma 5.5. The function H satisfies the following properties: 
(i) 

Mltll = Mltli, (15) 
where index z (resp. w) indicates the action of the Macdonald oper- 
ator Aiqt on z (resp. w) variables 

(ii) 

oo n Af ^ \ ^ m 

^("> = n n n „4r' n nc - '-'»^,) do) 

r=Oi=ll=l ^ ^ j=l I 

(iii) 

ifiMl^U) = Mn,m,qM'^) (17) 

Proof. The first part is well known, see Macdonald [4J, formula (3.12) in 
Chapter 6. 

To prove the second one we note that since <p is a homomorphism it is 
enough to consider the case = 1 when we have only one variable w. Define 
the following automorphism aq^t : A — s- A by 

1 - q' 

<^q,t{Pr{y)) = J—^Priy)- (18) 
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We have (cf. ^] 



r=Oi=l ^ ^ Vr=Oi>l ^ ^ 

°° " 1 J.-1 r I oo ^ I ^ 

r=Oi=l ^ \ r=Oi>l ^ ^-^ 



TT T-T 1 - i / , TT TT ^ ~ * ^9'"yi^« 
' I I 11 ~i T expcj^^t lill— i ; — 

r=Oi=l ^ * \ r=Oj>l ^ ^-^ 



1 - t-WxjW l^^^q^^yjyf-t-y^^' 



nn ' ^ expa,, y y y 

iiii l-gr-j;.-u; ^ 9,t I 

r=Oj=l ^ \r=0 j>l s>l 



-■--^ l — q^XiW \ I — q^ s 

-A- 1 - t~^g'"xi'u; (sr^l-r w 

r=Oi=l ^ * ys>l 

CO n ^ I J, I 

TT TT 1 — I q XiW I \ - „ , . w 

1 — t q XiW 



q' XiW ^ 

r=Oj=l ^ * j=l 

This proves the second part of the Lemma. 

Let us prove (in). It is easy to check the fohowing equahties 

n m I 

^(n) W(n) = n^3FTi^n 

,(n)-'r,,,,(n) = nr^75^. 
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1 - VjWi 
VjWi ' 



Now we see that {in) is equivalent to the fohowing equahty 

N I n m ^ I \ 

TQ T TT r (19) 



where 



N n , m m n 

From the partial fraction decomposition we have 

n rn i 

-p-r 1 - XjWl yr 1 - t ^qVjWl _ ^ 

1 - t-^XiWl ^^jL 1 _ t-^yjWl 

^ 1 - t ^Xiu;; ^ 1 - * yjWi 

N N „ 

1=1 ^ ~ ^'^y^'^i 1^1^ ~ ^'^yj^i ' 

Substituting these identities into relation (fT9|) we reduce it to the following 
equality 

A'' n m 

{eg- - 1) ^ G = (t^ - 1) E + - 1) E 5,, 

i=l j=l j=l 

which follows from the identities 



i=l i=l i=l 



^ t - 1 



Lemma is proved. □ 

To complete the proof of the Theorem we need Macdonald's result that 
the coefficients gx{z, q, t) in the expansion of the function 

oo oo ^ I J. 

n = n n n r-I.r = Ef^(^. ^. 

j=lr=Oi=l ^ ^ ] X 

linearly generate A when we increase the number of variables w (see ^4], VI, 
(2.10)). □ 
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Let us introduce the set of partitions Hn^rm which consists of the partitions 
A such that Xn+i < m or, in other words, whose diagrams are contained in 
the fat {n,m) - hook (see Fig.l). Its complement we will denote as Hn^m- 



Fig. 1: Fat hook 

Theorem 5.6. If q,t are non-special then Kenp is spanned by the Mac- 
donald polynomials P\{z,q,t) corresponding to the partitions which are not 
contained in the fat {n,m)-hook. 



Proof. Consider the automorphism agt of algebra A defined above by (jlSl) : 



1 



7Pr 



Then using formula (6.19) from [4] (see page 327) it is easy to verify that 
ag,tiPx{z,q,t)) = i-l)\'^\ ^';^;l'*\ py{z,t,q). (20) 



Let now x = {xi,X2, . . . ), y = {yi,y2, ■ ■ ■ ,) be two infinite sequences. Then 
we have (see 0], page 345, formula (7.9 )) 

Px{x,y,q,t) =Y,P^/^^{x,Q,t)PAy,q,t), (21) 

where Px/^z, q, t) are the skew Macdonald functions defined in [4J (see Chap- 
ter 6, § 7) and n C X means that fii < Aj (or equivalently the diagram of fi 
is a subset of the diagram of A). 

If we apply this automorphism ag^t acting in y variables on both sides of 
the formula pip and put all the variables x and y except the first n and m 
respectively to zero we get 

^{Px{z,q,t)) = Y,{-lt\Px/,{x.q.t)^^^^P,,{y,t,q). (22) 
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Now let us assume that A is not contained in the fat (n, m)-hook, then 
-^m+i > We have two possibihties: iJ-'m+i > or n'^^i = 0. In the 
first case we have Pfj_'{yi, . . . ,ym,t,q) = 0. In the second case we have 
^'m+i ~ A'm+i > so according to [1] (page 347, formula (7.15)) the skew 
function P\/f^{xi, . . . , Xn, q, t) = 0. Thus we have shown that the Macdonald 
polynomials Px{z, q, t) with A € Sn,m belong to the kernel of ip. 

To prove that they actually generate the kernel let us consider the image 
of the Macdonald polynomials Px{z,q,t) with A € Hn,m- From the formula 
([22|) it follows that the leading term in lexicographic order of if{P\{z,q,t)) 
has a form 

H{fi',t,q) 

where /i = (A„+i, A„+2, • • • )■ From the definition (p{Px{z, q,t)) G A„,m,g,t. It 
is clear that all these polynomials corresponding to the diagrams contained 
in the fat hook are linearly independent. The Theorem is proved. □ 

Note that we have also shown that for the generic q, t the restriction of 
the Macdonald polynomials on the subvariety /^n,m,q,t c M 

SPx{x,y,q,t) =ip{Px{z,q,t)), X e Hn,m (23) 

form a basis in An,m,q,t- By analogy with Jack polynomials case (see e.g. 
P]) we call SPx{x,y,q,t) the super Macdonald polynomials. 

Corollary 5.7. Let f £ At be a shifted symmetric function and Ai^t = 
xif) £ ^q,t be the corresponding difference operator commuting with MR op- 
erator Mq^t- Then for generic q, t there exists a difference operator M^^^^^ f^ 
commuting with the deformed MR operator ([T]) such that the following dia- 
gram is commutative 

A ^ A 

^^n,m,q,t ^ ^^n,m,q,t 

All the operators M^^^ j commute with each other and the super Macdonald 
polynomials \23\) are their joint eigenf unctions. 

Remark. For special q,t of the form q = t^ where k is nonnegative 
integer the homomorphism can be passed through the finite dimension 
N = n -\- mk: ip = (p o (ppf, where (pN ■ A An is the standard map (all Zi 
except N go to zero), and : Ajy — > An^m,q,t is a homomorphism such that 

(j){zi) =Xi, i = l,...,n, cl){zn+kl+j) = t^'^Vh I = l,...,m, j = l,...,k. 

When m = 1 the corresponding ideal (the kernel of (j)) was investigated by 
B. Feigin, Jimbo, Miwa and Mukhin in P], who also described it in terms 
of Macdonald polynomials, but their description is much more complicated 
then in generic parameters case. The case k = 2,m = 2 was studied in [14j . 
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We investigate the homomorphism: / — > mgt '^^ more detail in the 
next section, but here we finish with the following result mentioned at the 
beginning of this section. 

Recall that the parameters q,t are call special if q"' = for some non- 
negative integers a, b not equal to zero simultaneously. 

Theorem 5.8. If the parameters q,t are non-special then i^n,m,q,t is gener- 
ated by the deformed Newton sums pr{x,y, q,t). 

The main idea is standard for this kind of result (see e.g. [1]). We show 
that the dimensions of the homogeneous components of the algebra An^m,q,t 
and its subalgebra Mn,m,q,t generated by the deformed Newton sums are 
the same and thus these two algebras coincide. More precisely, we prove 
that these dimensions coincide with the number of the corresponding Young 
diagrams contained in the fat (n,m)-hook (see Fig. 1 above). 

Lemma 5.9. // g, t are not special then the dimension of the homogeneous 
component An^m;q,t of degree N is less or equal than the number of partitions 
X of N such that A„+i < m. 

Proof. For a given partition v consider the set of all different partitions z/, 
which one can get from by eliminating at most one part of it (or one row in 
the Young diagram representation). We have the following obvious formula 

m^{xi,X2, . . . ,Xn) = ^ x1m,0{x2,. ■ ■ ,Xn) (24) 
uU{a)=u 

where (a) denote the row of length a. Any element / G An,m,q,t can be 
written in the form 

/ = ^c(A,^)mA(xi,X2, . . ■,Xn)m^{yi,y2,.. .,yn) 

Then from the equality ()24p we have the linear system 

(g'^-t^)c(AU(a),/xU(6)) = 0, (25) 

a+b=p 

where a,b,p nonnegative integers and A,/i are partitions such that A„ = 
0, Hm = 0. 

Consider the set Xiy{n,m) of pairs A, ^ of partitions such that|A| + |//| = 
N, Xn+i = 0, fim+i = 0. Then we have disjoint union 

Xj\f{n, m) = Dj\f{n, m) U i?Ar(n, m), 

where D]\f{n,m) is the subset of pairs (A,^) of partitions such that A„+i < 
m. Note that the corresponding Young diagrams AU^', where fi' corresponds 
to the transposed Young diagram, are precisely those which are contained 
in the fat (n, m)-hook. We would like to show that one can express c(A, /i) 
for all others partitions as a linear combinations of those from D]\[{n,m). 
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Consider any (A,^) G RN{n,m) : A = (Ai, . . . , A„), // = (/ii, . . . , /i^). 
Define 

/c = JJ{i I Aj < fi[} 

and 

^(g) = Hs-q+l H h /is 

for any integer < q < s. Introduce the following partial order on Ri\i{n, m) : 
(A, ii) -< (A, fl) if and only if A; < A; or one of the following conditions is 
fulfilledj 

k = k and for q = mm{A„, A„}, + 1) < fl{q + 1) 

k = k and for q = niin{Xn, Xn}, IJ-iq + 1) = + 1) and A^ < An- 
We prove Lemma by induction in N{x) = ^{y ~< x \ y G R]sf{n,m)}. Let 
(A,//) € RN{n,m). Consider equation (f25]) where A = (Ai, . . . , A„_i) and 
fl = (/ii, . . . ,fis-x„-i,fJ-s-x„+i, ■■■ ,IJ's) and p = A„ + fis-\„- It is easy to 
see that the equation contains c(A, fi) with non-zero coefficient and (A, fi) is 
maximal among all irregular pairs in this equation. □ 

Now let us prove the Theorem. To show that f^n,m,q,t — -^n,rn,q,t it is 
enough to prove that the dimension of the homogeneous component of degree 
N of Mn. ■m,q,t is not less than D]\f(n,ni). To produce enough independent 
polynomials consider the super Macdonald polynomials (j23p 

SPx{x,y,q,t) = ip{Px{z,q,t)), A e Hn,m- 

Prom the formula (|22p below it follows that the leading term of SPx{x, y,q,t)) 
in lexicographic order has a form 

™Ai \„ <K^"> <X'^-n> 
•^1 • • • -^n »1 ■ ■ ■ ym ' 

where A' is the partition conjugate to A and < x >= ^il^ = max(0, x). 
From the definition ip{Px{z, q,t)) G Mn,m,q,t- It is clear that all these poly- 
nomials corresponding to the diagrams contained in the fat hook are linearly 
independent. This completes the proof of Theorem 15.81 



6. Shifted super Macdonald polynomials and Harish- Chandra 

homomorphism 

Let again Pn,m = C[xi, . . . , x„, yi, . . . , ym] be polynomial algebra in n-|-m 
independent variables. The following algebra ^ ^ ^ can be considered 
as a shifted version of the algebra An^m,q,t- It consists of the polynomials 
p{xi, . . . , Xm yi, ■ ■ . , ym), which are symmetric in xi,X2t, . . . , Xnt^~^ and 
yi,y2<l ■ ■ ■ , ym<f^~^ separately and satisfy the conditions 

T,,,Af)=Tt,y,U) (26) 

on each hyperplane Xif~^ — yjq^~^ = for i = 1, . . . , n and j = 1, . . . ,m. 

Now we are going to define the homomorphism ip^ which is a shifted 
version of the homomorphism ip from the previous section. 
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Recall that -ffri,m denote the set of partitions A whose diagrams are con- 
tained in the fat (n, m)-hook. Consider the following F : Hn,m — ^ {[^n+m . 
= {Pi, • • • ,Pn,9i, • • • ,9m), where 

and fi = (A„+i, A„+2, . . . ). The image F{Hn,m) is dense in C"^"* with respect 
to Zariski topology. The homomorphism 

if^ : At — > C[xi, ...,Xn,yi,.. .,ym] 
is defined by the relation 

V>\f){P,q) = f{iF-\p,q)), 

where {p,q) € F{Hn,m)- In other words we consider the shifted symmetric 
function / as a function on the partitions from the fat hook and re- write it 
in the new coordinates. The fact that as a result we will have a polynomial 
is not obvious. 

Lemma 6.1. The image (p^{f) of a shifted symmetric function f ^ At is 
a polynomial. For the shifted power sums p'^{z,t) it can be given by the 
following explicit formula: 

n ^ J, m 

{pUz,t)) = - ^v^'-'^ + Y^E(yJ - tng'^'-'^- (27) 
i=i j=i 

Proof. Assume that = Aj, where A G Hn^m- Then we have 

^\pl{z,t)) = = ^(g'-A._l)tK-l)+i-^(^rA„+,_i)^.(-l). 

i>l i=l i>l 

Now using ([5]) we have 

i>i j=i 

which proves the formula (|27p . Since the shifted sums generate At this 
implies the first part of Lemma as well. □ 

Theorem 6.2. // the parameters q,t are generic then the image of the 
homomorphism <^ coincides with the algebra A^^^^ and the kernel of ip^ 
is spanned by the shifted Macdonald polynomials P^iz, q, t) corresponding to 
the Young diagrams which are not contained in the fat {n,m)-hook. 

Proof. The first claim follows from Lemma 16.11 and Theorem 15.81 To prove 
the statement about the kernel consider a shifted Macdonald polynomial 
P'^(z,q,t) with A € Hn^m- Let /i be a partition whose diagram is contained 
in the fat (n, rTT-)-hook. Since this implies that the diagram of A is not a 
subset of the one of according to the Extra Vanishing Property of shifted 
Macdonald polynomials (see Section 3) we have Px{q'^,q,t) = 0. Thus we 
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have shown that P^{z,q,t) with A G -f^n,m belong to the kernel of (p. To 
show that they generate the kernel one should note that 

^\Px{z, q, t)) = ip{Px{z, q, t)){xi,X2t, Xnt''-\yuy2q • • • , ymQ"""^) + • • • , 

where dots mean the terms of degree less then |A|. From theorem 15.61 it 
follows that (p^{P^{z, q, t)) with A G i?„, m are linearly independent. Theorem 
is proved. □ 

Corollary 6.3. For generic q, t the functions 

SPl{x,y,q,t) = ^\Pl{z,q,t)) 

with A € Hji^m form a basis in A^^ ^ ^ ^ . 

We will call the polynomials SP^{x,y,q,t) the shifted super Macdonald 
polynomials. We are going to show that to any such polynomial corresponds 
a quantum integral of the deformed MR system. 

Let us consider the algebra of difference operators in n + m variables with 
rational coefficients belonging to C[xi, . . . , Xn, yi, . . . , ym, {xi — Xj)~^, {xi — 
yi)~^,{yk — I < i < j < n,l < I < k < m. We denote it as 

A(n, m). 

Theorem 6.4. For generic values of q, t there exists a unique monomor- 
phism ip : A.^n,m.q,t ~^ A(n, m) such that the following diagram is commuta- 
tive 

At ^ A{q,t) 

I ip^ I res 

^i,m,q,t ^ A(n,m), 
where x is the inverse Harish- Chandra homomorphism and res is the oper- 
ation of restriction onto A{n,m,q,t) described by Corollary \5.1\ 

Indeed let / be a shifted symmetric function from A^ , ^ and A4{ rnqt~ 
res{M-q -i-) be the same as in Corollarv 15. 7[ We know that if P\{z,q,t) is a 
Macdonald symmetric function then 

■A^lm,g,t¥'(^A(^, = f{q^)p{Px{.z,q,t)). 

Therefore according to Theorem 15.61 M.l^ „^ = if and only if f{q^) = 
for any A with the diagram contained in the fat (n, m)-hook. Now from 
Theorem 16.21 it follows that Ker{res o x) = KeripK 

7. Combinatorial formulas 

In this section we give some combinatorial formulas for the super Mac- 
donald polynomials and shifted super Macdonald polynomials generalising 
the results by Okounkov [8j. Let us recall his results. 

A tableau T on A is called a reverse tableau if its entries decrease strictly 
downwards in each column and weakly rightwards in each row. By T(s) we 
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denote the entry in the box s £ X. The following combinatorial formula for 
the shifted Macdonald polynomial was proven by Okounkov in [8]: 

P,*(xi, ...,XN,q,t)=Y,MQ,t)ll [xTis) - (28) 

T sex 

where a'{s) and l'{s) are defined for a box s = as 

a'is)=j-l, l'{s) = i-l. 

Here the sum is taken over all reverse tableaux on A with entries in {1, . . . , N} 
and ipT^Qji) is the same weight as in the combinatorial formulas for the or- 
dinary Macdonald polynomials (see [3], VI, (7.13')) interpreted in terms of 
reverse tableau: 

Px{xi, ...,XN,q,t) = '^i'T{q,t)Y\_XT{s)- (29) 

T sgA 

P\/^,{xl,■■■,XN,q,t) = J2^T{q,t) xrp{s)- (30) 

In the last formula the sum is taken over all reverse tableaux of shape A/// 
with entries in {1, . . . , N}. 

Let us consider now a reverse bitableau T of type (n, m) and shape A. We 
can view T as a filling of a Young diagram A by symbols 1 < 2 < • • • < 
n < 1' < 2' < • • • < m' with entries decreasing weakly downwards in each 
column and rightwards in each row; additionally entries 1,2. . . ,n decrease 
strictly downwards in each column and entries 1', 2' . . . , m' decrease strictly 
rightwards in each row. Let Ti be a subtableau in T containing all symbols 
1', 2' ... , m' and Tq = T — Ti and /x is the shape of Ti. 

Theorem 7.1. For generic values of the parameters q,t the super Macdon- 
ald polynomials can be written as 

SPxixi,X2, . . . , x„, yi,y2, . . . ,ym,q,t) = ^l^riq, t) x^i^s) (31) 

T seA 

where Xji is denoted as yj and 

H{jx,q,t) 



i^T{q,t) = i-l)^^^ i'Tl{t,qWo(.q,t) 



H{i^',t,, 



Proof follows directly from the formulas (P^ . ([2g|) . pi|) . 
We are going to present now a combinatorial formula for the shifted super 
Macdonald polynomial. 

Theorem 7.2. The following formula is true: 

T sex 
where (g, t; s) = q if s G Ti and (g, t; s) = t if s £ Tq. 
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Proof. Let us consider the skew diagram A//U in the formula (|29|) and define 

Okounkov in [8j proved the fohowing formula 
P*,{zi,z2 ...,q,t) = Y^ ^x/,iQ, t) n (^1 - g'^'^^)/^^)) tl^lp;(^2, ^3 . . . , t), 

(32) 

where ^ -< A means Aj+i < Hi < Xi and ipx/f^{q,t) is the same coefficient as 
for the ordinary Macdonald polynomials [4j 

Px{zi,Z2...,q,t) = i^x/t^iq, t)z[^^^^ P^{z2, Z3...,q,t). 

Strictly speaking Okounkov proved this for finitely many variables. To make 
sense of formula (j32p in infinite dimension we embed the algebra At to 
C[2:i] (g) At by sending pi to z'[ - I + t'^p^. 

Applying Okounkov's formula n times we get 

Pl{zi,Z2 ...,q,t) = Y, Pl/^,{Zl,Z2, ...,Zn,q, t)rl'^lp;(z„+i, Zn+2 ■■■,q,t), 
fiCX 

which implies 

V^Pxi^i ,Z2...,q,t)) = Y^ P*/^{xi,X2, ■■■,Xn,q, t)e\f'\u;lt{P;{zn+i,Zn+2 ■■■,q, 
Now using the duality ^ we have 

'p\Pxizi^Z2 ...,q,t)) = ^F;^/^(xi,X2, . . .,Xn,q,t) ^1^/ ^' P*, {yi , y2 ■ ■ ■ ,ym,t 
But according to formula (f28|) 



p;'iyi,y2...,ym,t,q) = Y,ijTiit,q) H - *"'^''^/^''^) 



Therefore 

and the Theorem is proved. □ 
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8. Concluding remarks 



Haglund, Haiman and Loehr [16] recently proved a remarkable new combi- 
natorial formula for Macdonald polynomials, previously proposed by Haglund. 
These formulas are much more effective than the original Macdonald's for- 
mulas (I29p and provide a new direct way to prove the main properties of Mac- 
donald polynomials. A natural problem is to find an analogue of Haglund's 
formula for the super Macdonald polynomials. 

Another open problem is to find generalisations of our results for the 
deformed analogues of the Macdonald operators related to other Lie super- 
algebras (see [1]), in particular for the deformed Koornwinder operators. We 
hope to address some of these questions in the nearest future. 

9. Acknowledgments 

We are grateful to A. Okounkov for useful and stimulating discussions. 

This work has been partially supported by the EPSRC (grant EP/E004008/1), 
European Union through the FP6 Marie Curie RTN ENIGMA (Contract 
number MRTN-CT-2004-5652) and ESF programme MISGAM. 

References 

[1] A.N. Sergeev, A. P. Veselov Deformed quantum Calogero-Moser Problems and Lie 

superalgebras. Comm. Math. Phys. 245 (2004), no. 2, 249-278. 
[2] A.N. Sergeev, A. P. Veselov Generalised discriminants, deformed Calogero-Moser- 

Sutherland operators and super-Jack polynomials. Adv. Math. 192 (2005), no. 2, 341- 

375. 

[3] S.N.M. Ruijsenaars Complete integrability of relativistic Calogero-Moser systems and 
elliptic function identities. Comm. Math. Phys. 110 (1987), no. 2, 191-213. 

[4] L Macdonald Symmetric functions and Hall polynomials 2nd edition, Oxford Univ. 
Press, 1995. 

[5] F. Knop, S. Sahi, Difference equations and symmetric polynomials defined by their 
zeros. Internal. Math. Res. Notes 10, 1996, 437-486. 

[6] F. Knop Symmetric and non-symmetric quantum Capelli polynomials. Comment. 
Math. Helv. 72 (1997), no. 1, 84-100. 

[7] S. Sahi Interpolation, integrality, and a generalization of Macdonald's polynomials. 
Internal. Math. Res. Notices (1996), no. 10, 457-471. 

[8] A. Okounkov (Shifted) Macdonald polynomials : q- integral representation and com- 
binatorial formula. Compositio Math. 112, 1998, no. 2, 147-182. 

[9] B. Feigin, M. Jimbo, T. Miwa, E., Mukhin. Symmetric polynomials vanishing on the 
shifted diagonals and Macdonald polynomials. Int. Math. Res. Not. 2003, no. 18, 
1015-1034. 

[10] O.A. Chalykh Macdonald polynomials and algebraic integrability. Adv. Math. 166 

(2002), no. 2, 193-259. 
[11] A. P. Veselov, M.V. Feigin, O.A. Chalykh New mtegrable deformations of quantum 

Calogero - Moser problem. Russian Math. Surveys 51, no. 3, 1996, 185-186. 
[12] I. Cherednik, Double afiine Hecke algebras and Macdonald's conjectures, Ann. of 

Math. (2) 141 (1995), no. 1, 191-216. 
[13] A.N. Kirillov, M. Noumi Affine Hecke algebras and raising operators for Macdonald 

polynomials. Duke Math. J. 93 (1998), no. 1, 1-39. 

22 



[14] M. Kasatani, T. Miwa, A.N. Sergeev, A. P. Veselov Coincident root loci and Jack and 
Macdonald polynomials for special values of the parameters. Jack, Hall-Littlewood and 
Macdonald polynomials, 207-225, Contemp. Math., 417, Amer. Math. Soc, Provi- 
dence, Rl, 2006. 

[15] M. Atiyah, I.G. Macdonald Introduction to Commutative Algebra. Addison- Wesley, 
1969. 

[16] J. Haglund, M. Haiman, N. Loohr A combinatorial formula for Macdonald polynomi- 
als. J. Amer. Math. Soc. 18 (2005), no. 3, 735-761. 

Department of Mathematical Sciences, Loughborough University, Lough- 
borough LEll 3TU, UK AND Steklov Institute of Mathematics, Fontanka 27, 
St. Petersburg, 191023, Russia 

E-mail address: A.N.Sergeev@lboro.ac.uk 

Department of Mathematical Sciences, Loughborough University, Lough- 
borough LEll 3TU, UK AND Landau Institute for Theoretical Physics, Moscow, 

Russia 

E-mail address: A.P.Veselov@lboro.ac.uk 



23 



